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Abstract. We propose an explicit construction of the solution of a stationary 
stochastic recursion of the form X oO = on a semi-ordered Polish space, 

when the monotonicity of is not assumed. This solution exists on an enriched 
probability space (it is said weak), provided the recursion is lattice- valued, and 
dominated by a proper monotonic stochastic recursion. 



Let f be a Polish space that is endowed with a partial ordering ^. We assume 
that S admits a minimal point denoted by Og, and is such that any ^-increasing 
sequence converges (possibly to some element of the adherence of 8). Any subset 
A C f is said loccaly finite if for any compact subset C C £, An C is of finite 
cardinal. Let Z, N and N* denote the sets of integers, of non-negative integers and 
of positive integers, respectively. 

Consider a probability space {n,T,P), where {^,^) is Polish, furnished with 
the measurable bijective flow 9 (denote , its measurable inverse). Suppose that 
P is stationary and ergodic under 0, i.e. for all A P [0^^A\ = P [A] and all 
A that is 6*- invariant (i.e. such that 9 A = A) is of probability or 1. Note that 
according to these axioms, all ^-contracting event (such that P [A'^ n 6*"^^] — 0) 
is of probability or 1. We denote for all n G N, 6'" = 9 o 6 o ... o 6 and 9^^ = 
9~^ o 9^^ o ... o 9^^ . Except when explicitely mentionned, throughout all the r.v. 
are defined on {fl,J-,P). 

We denote Ai{£) the set of mappings from £ into itself. For any A^(£)-valued 
r.v. F, for any x E £, let Fi^{x) be the image of x through F for the sample uj. 
For any / G M.{£), and any subset B C £, we denote f{B) — {f{x);x € B}, and 
accordingly for any A^(f )-valued r.v. F and all sample uj, F^[B) = {Fuj{x);x G B}. 

Let be a A^(f )-valued r.v.. For all f -valued r.v. X, let {Xx,n}nefi 
£-valued stochastic recursive sequence (SRS for short) initiated by X and driven 
by if, i.e., such that P-a.s., 



Define for all sample lo, all n and .t G 

We investigate the existence of a stationary version of the sequence {Xx,n}„gpj, i-C. 
such that Xx,n — X o9"' for all n G N. Then it is easily seen that the r.v. X solves 
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= ^06*" {Xx.n) , for all n G N. 
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the stochastic recursive equation (SRE for short): 

(1) Xoe = ip{x). 

The existence of a solution to this functional equation on the original probability 
space is not granted in general, without further assumptions on ip, such as mono- 
tonicity and continuity (as assumed by Loynes' theory). We propose in this paper a 
technique alternative to that of renovating events (see [4|) for solving ([1]) in a more 
general context. More precisely, we aim to construct an extension of the probability 
space, on which the existence of the solution is granted. The main assumption that 
will be used here is the domination of the original SRE by a proper one, in a certain 
sense. We assume throughout that 

(HI) For some A4{£)-valued r.v. ip, 

• for all X <E £, 

Of di di ipix), P — a.s.; 

• ip is P-a.s. <-non decreasing; 

• the SRE 

(2) Yoe^ij{Y) 
admits at least one £-valued solution. 

2. Euclidian case: Existence result 

Throughout this section, we assume that £ is the euclidian space M", where 
71 > 1, equipped with the coordinatewise ordering The domination by a 

proper SRE (Hypothesis (HI)) is a key argument for applying Anantharam and 
Konstantopoulos's results (see [Il[2]): the tightness of the dominated sequence is 
then easily obtained, and guarantees the existence of an extension of the original 
probability space, on which a solution to (U) exists. 

Theorem 1. Suppose that (HI) holds, that 

(H2) -0 is P-a.s. continuous, 
and that either one of the two following conditions holds: 

(H3) ip is P-a.s. continuous; 

(H4) ip admits F-a.s. a countable number of discontinuities, and there exists a 
locally finite subset C C £ that includes Og and that is P-a.s. stable by ip. 

Then, there exists an extension (J),,T,P,d) of {ft, J- ,P, 9), that is such that 

• P is a 0-invariant probability on Cl having fl-marginal P , 

• there exists a £ x M.{£)-valued r.v. {X,(p^ defined on such that the 
^.-marginal of ip is the distribution ofip, and such that 

Xo6^^{X),P^ a.s.. 

Proof. This result is a consequence of Theorem 1 in [T], whose hypothesis are cor- 
rected in |2]. The tightness of the embedded SRS (implied by the domination 
assumption (HI)) is the key arguement. Let X be the Borel sigma-field on £, and 
define 

• ^ ■.— ^I'K £, 
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• for all (w, x) e 0., 

9{uj, x) = {Ouj, (fiujix)) . 

It is an immediate consequence of Loynes' Theorem for stochastic recurrences 
([3 12) that under assumption (H2), there exists a solution, say Fqo, to The 
r.v. Yoo is given by the a.s. limit of the sequence {i^o£,n ° ^~"}„gN- Note, that Yoo 
may in general be improper (i.e. valued in some £ D £). However, Fqo is r^-niinimal 
among all the solutions of and the last assertion of Hypothesis (HI) entails 
that Yoo is 5- valued. 

In particular, the sequence {yo£,n}„gp} tends weakly to 1^00- It is thus tight 
(Prohorov's Lemma): for all e > 0, there exists £ £ such that for all n € N, 

^[Yoe,n<M,] >l~e. 

In view of the first assertion of Hypothesis (HI), an immediate induction shows 
that 

Xo^^n < >Of:,n, 71 £ N, P - a.S., 

SO that 

P[^0£.„ < Me] > 1 - 71 e N, 

which shows the tightness of the sequence {Ybf.nlngpj- 

Remark that for sX\n Ae T and B <eX, 

P 5o^ [^"" {A X f )] = P [e-^A] = P [A] 

and 



. So, [6I-" {ny.B)\=-p® Soe 



|(w,x) e 17;X^,„(w) G S| 



P[Xo,,neB]. 



Hence, the probability distributions \ {P ^ Sq,) o 9 " > on fl have fi-marginal 

L J riGN 

P and ^-marginals, the distributions of {Xo£,„}^gj^, which form a tight sequence. 
The sequence <^ (P (8) (Sof) o > is thus tight, which is the first condition of 

L J neN 

Theorem 1 in p]. 



We now have to check that either one of the conditions (Al)-(A3) p. 271-272 of 
[2] holds in order to apply Theorem 1 in [1]. First, under condition (H3), the shift 
9 is continuous from fl x £ into itself, which is condition (Al) in [2]. 

Let us now assume that (H4) holds. Fix p G N* and a sample uj. Denote 
2? = ) the set of discontinuities of (fuj (note that J is P-a.s. countable 

by hypothese). For all j £ Juj, let C^j^pj be some point of £ such that 

S(j,pj be the bowl of center Cui^pj and radius 2~p and 

Bu)^p — Bu^pj- 

There exists a continuous function ip^^^p from £ into itself, such that Lpuj,p coincides 
with ip^ outside the open set B^^p. Finally, define the shift 9p for all {w,x) G 1^ by 

9p{uj,x) = {9uj,ip^^p{x)) , 
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SO that 9p is continuous from fl into itself. It is clear from (H4) that for alH > 1, 
(Og) e C, P-a.s., so that 

P[$'(0£) eBp] <P[CnBp^9]. 

Set 

Up = {{uj , x) e Ci; X e B^^p} . 

Then, Up is an open subset of fi, and in view of the latter inequality, 

n — 1 1 ^ 

lim liminf- V (P ® 4) o (^p) = lim liminf- V P (Og) £ S„l 

i=0 1=1 

< Hm P [£ n 7^ 0] = 0, 

p — *oo 

since £ is a locally finite set. Therefore, the last assumption of Theorem 1 of [1] is 
verified (see [2] for the additional assumption (A3), p. 272). We can therefore apply 
this result, yielding that there exists a 6'-invariant probability P on 17 x R whose 
ri-marginal is P. Define now on fl the random variables 

X{uj,x) := X, (p^^-j; := ip^j. 

We then have that 

(3) X o 9{uj,x) = (pu>ix) = (fiuj.x (x) = (pu,,x {X{uj,x)) ,P - a.s., 

hence X is a proper solution to |[TJ on (f2, JF, P, ^) . □ 

3. Explicit construction 

In some cases, the extension, on which a solution to |(T|) exists, can be explicitely 
construct. For doing so, we follow an argument related to that developped by Flipo 
([5]) and Neveu ([8j) for the SRS describing the workload of a loss queueing system 
G/G/1/1. 

Additionally to Hypothesis (HI), let us assume throughout this section that the 
following assumption holds. 

(H5) For some subset fC of £ that is stable by ip, for some £-valued solution Y 
to 10), the set Qui = {x G /C; a; ^ Y{uj)} is P-a.s. non empty and of finite 
cardinal. 

Let V{1C) denote the power-set of /C. In the sequel, Y denotes an arbitrary ^-valued 
solution to ^ satisfying assertion (H5). 

Let us fix a sample w G an integer n G N* and a; G /C. First, it is easily seen 
by induction that <^"'{x) G K. P-a.s. Now define 

QZ ■■= Qe-u, = {x^K:x<Yo 0-"c^} , 

ni := c (g«) . 

The random set H" then represents the set of all possible values of the recursion 
driven by ip at 0, when letting the the value at —n vary over the (a.s. finite and 
non empty - see (H5)) set of elements of JC that are majorized by F o f?^". We 
have that 

Lemma 1. The sequence of random sets {H"'},,^^^ is a.s. decreasing for the inclu- 
sion. 
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Proof. Let n G N*. Then, we have a.s. for all x G 7Y^+\ that for some y G 

(4) a; = $ri(2;) = $:;(^,-(„+„Jy)). 
On the one hand, since y G GZ'^^, 2/ £ ^ and hence 

(5) fe-i"+^)uj{y) e ic. 

On the other hand, y diY (^^^"+^•'0;) . Hence, in view of (H2), the a.s. monotonicity 
of tp and the fact that F is a solution to the functional equation ^ , we have that 



= Yo 



which means with ^ that <<3e-(r,+i)^(y) G GZ- Hence, x G W^, wich concludes the 
proof of the Lemma. □ 

It then follows from the fact that the random sets W, n > 1 are a.s. non-empty 
and of finite cardinal, that 

(6) flK^0,P-a.s.. 

n>l 

Moreover, 

Lemma 2. The r.v. Card Ti. is deterministic. 
Proof. Fix 71 > 1. We have a.s. that 

= G e:;} = (C(^)) ;^ e c;:} = (K) • 

This impHes in particular that Card Hg^^ < Card HZ, P-a.s. for all n G N*. 
Letting n go to infinity, this implies that Card Tieuj < Card Hui, which concludes 
the proof in view of the ergodicity of P under 6. □ 

On another hand, we have the following property. 

Lemma 3. The mapping ipu: is bijective from Tiuj to Tieu, P-a.s. 

Proof. The following assertions hold on a P-almost sure event. Let x G Hu)- In 
other words, x G n„>i7Y", wich amounts in turn to say that for any n > 1, for 
some y-n ^ GZ T ^ — ^ZiVn)- We therefore have that 

LPu,{x) ^(fiujO O ... O ip0-^^{yn) = '^'et^iVn), 

where y„ G G^ = Ggl^^ ■ This is true for all n> 1, hence (fuj{x) belongs to the set 

n>2 n>2 

SO that ipuj maps Hu: onto Heu- 

Now, to check that (puj is surjective, fix y G Houj- For any n > 1, for some 
Xn e Gg^, we have that y = ^e^{x„) = (pu{zn), where 

Therefore, ipui is bijective from Ti^j into Houj since these two sets have the same 
cardinal (Lemma [2]). □ 
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Explicit construction of the extension. We propose now an enrichment of the 
original probabiHty space {il, T, P, Q) on which a solution to HI) can be constructed. 
Denote by c, the almost sure cardinal of the set H. 

Proposition 1. The quadruple (^tl, P, 6j defines a stationary dynamical system: 

• fi = {{uj, x) e n X £;x e Hiij)} ; 

• f= {^nO;^ e j^(8)7'(A:)} ; 

• For all Ae T,B eV{lC), 



P X B] = 

c 



l^Card rLr\B 



" \yeB I 

For all Lu ^ il,x G JC, 9{u!, x) — {9ui, ipuj{x)) ■ 



Proof. To check this, first remark that defines an automorphism of fl in view of 
Lemma [31 On another hand, P defines a probability measure, since it clearly is a 
(T-finite measure, that is such that 

P[nxlC] = -I] [loCard'W] = P [CardH = c] 1. 

c 

Now {lxAxBgT. Then, 

P\9-'{AxB)\ = f f le-iA^)M^^)-^B){y)dP{uj,y) 



n 



x&B \aeHg_i^ / 



in view of the invariance of P under 9. But in view of Lemma [21 P-a.s., x G Huj if 
and only if 

where yo is the unique antecedent in Tig-iuj oi x by ipg-i^. Hence the latter integral 
equals 

V / lAHlnAx)dP{iu)^P[AxB], 

which shows that P is 6*- invariant. □ 

Finally, let X (resp. ip) be the restriction on Ct of the r.v. X (resp. (f) defined 
in the previous section, that is, 

X{uj, x) = x,P — a.s., 
V'uj.xiy) = iPujiy) for ah ?/ G E,P - a.s.. 
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Then, as in ([3]), 




thus X is a solution to |(T|) on (fl,T,P,9]. We have proven the following result. 



Theorem 2. Under Hypothesis (HI) and (H2), there exists a stationary exten- 
sion (il,!F,P,9] of {ft, J- ,P, 9), given in PropositionUl on which the equation (QJ) 
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admits a solution X. Moreover, X{uj,x) ^ Y{uj) F-almost surely on ^l. 
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